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INTERORGANIZATIONAL MEASUREMENT: 
DIFKERENCES BETWEEN HIERARCHICAL 
LEVELS OF ORGANIZATIONS 

Gerald E. Klonglan Richard D. Warren Judy M. Winkelpleck- Steven K. Paulson 

ABSTRACT 

Interorganizational relations usually have been measured by a single 
indicator, rather than a composite measure. Our purpose was to use a 
cumulative, mul tl-i tem measure of interorganizational relations to assess 
the general izabi lity of lOR measures across organizational hierarchical 
levels. An eight-item scale, ordered from low to high intensity of lOR, was 
developed theoretically and empirically. Twenty-seven hundred administra- 
tions of the items, among state, district, and county hierarchical levels of 
156 health related organizational units, were studied. Guttman analysis was 
used to evaluate the empirical fit of data to the theoretical model. Three 
comparative frameworks were used: (1) an original theoretical ordering; 
(2) empirical orderings developed for each hierarchical level; and (3) three 
alternative theoretical orderings based on the best empirical ordering for 
each hierarchical level. When we used the primary criterion of coefficient 
of reproducibility, the scales were valid for the: (1) theoretical ordering - 
district and county levels; (2) empirical ordering - district and county 
levels; (3) all alternative theoretical orderings - district and county 
levels. When we used the criterion of coefficient of scalibility, the 
valid scales were: (1) theoretical ordering - district level; (2) empirical 
ordering - state and district levels; (3) first alternative theoretical 
ordering - state level; (k) second alternative theoretical ordering - district 
level. Inconsistencies in valid scales among organizational hierarchical 
levels indicated that hierarchical level may be a moderator for interorga- 
nizational relations; level influences theoretical, methodological, and 
applied developments in lOR. 



INTERORGANIZATIONAL MEASUREMENT: 
DIFFERENCES BETWEEN HIERARCHICAL 
LEVELS OF ORGANIZATIONS 



INTRODUCTION 

Past measurement of interorganizational relations (lOR) has often 
neglected the cumulative nature of interorganizational involvement. That 
is, the assumption has sometimes been theoretically operative, but not pre- 
sent in most lOR measures, that activities such as written agreements between 
organizations indicate a more intense lOR commitment than do such activities 
as interaction of organizational directors. Aiken and Hage (1968) used a 
single indicator to measure only a higher level of lOR involvement in count- 
ing the number of joint programs carried out between two organizations. 
Levine and White (I96I) used a series of indicators of lOR without devel- 
oping a composite measure. 

Finley's (1969) study is one of the two studies of which we are cognizant 
that develop cumulative multiple-indicator measures of lOR. Klonglan et_ aj[. 
(1972) combine assumptions about the developmental idea of lOR with multiple- 
indicator measures of the concept. The Klonglan et aj_- (^972) empirical 
analysis combined three hierarchical levels (state, district, and county) 
of the s^ime organizations. Given the infancy of the developmental assumption 
and of the use of multiple-indicators in lOR measurement, it seems that we 
should consider moderating effects (Ghiselli, I963), such as organizational 
level, on lOR theory and measurement. Our general objective is to assess the 
general izabi 1 i ty of the measurement of Interorganizational relations across 
hierarchical levels of organizations . 
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FORMS OF INTERORGANIZATIONAL RELATIONS 

Interorganizational relations, as defined in this paper, are the con- 
tacts occurring between members of an organization's task environment. Task 
environment, as conceptualized by Dill (1958), denotes the parts of the 
environment presently or potentially relevant to goal setting and attainment. 
Our usage of lOR is restricted to cooperative forms and does not include 
competitive or conflicting interorganizational relations (Thompson and McEwer, 
1958). 

Eight lOR Forms 

Using ideas suggested by Thompson and McEwen (1958), Litwak and Hylton 
(1962), and Finley (1969), Klonglan, et aj;^. , (1972) developed eight items to 

operational I ze forms of interorganizational relations. These items are mea- 
sures of organizational interaction which occurs in the process of developing 
interorganizational relations. Each item is measured by asking one organi- 
zation about its interaction with a second organization. The eight items are 
listed in the theoretical ordering used by Klonglan et_ al^^ (1972) to indicate 
lOR forms from low to high intensity. The rationale for this ordering follows 
the listing. 

The first three forms represent Litwak and Hylton's (1962) awareness of 
interdependence: 

(1) Director awareness of the existence of another organization; 

(2) D I rector acquai ntance between organ i zat i ons ; 

(3) Di rector i nte ract i on between organ i zat i ons ; 

The fourth item is a low level of resource exchange from Finley (1969): 

(k) Information exchange of newsletters, reports, and releases; 
Forms five through seven are from Thompson and McEwen (I958): 
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(5) Resource exchange (bargaining) of funds, materials, or personnel; 

(6) Overlapping board membership (co-optation) of staff or menters; 

(7) Joint programs (coalition) to plan and implement activities; 

The final item represents the standardized action of Litwak and Hylton (1962): 

(8) Written agreements to share activities between organizations. 

Ordering Rationale 

The first item or form specifies that the director is only aware of the 
existence of another organization. The next two forms represent a "feeling 
out" of the situation by the organization. It is assumed that initial con- 
tact is conducted by the principal administrator or "director," Often this 
relatively low level of relations is sufficient to obtain needed resources or 
goals. If it is not, the fourth level involves information exchange. The 
fifth form, resource exchange, represents further commitment to other organiza- 
tions in terms of funds, materials, or personnel skills. The sixth level, 
overlapping board membership, involves absorption of leaders of one or more or- 
ganizations into the power structure of a focal organization. This assists the 
organization in operating and legitimizing its domain. An organization still 
seeking resources may establish joint programs, the seventh form, that insure 
commitments from other organizations. The eighth and final step is to formalize 
commitments between organizations through written agreements. At this step, 
the organization is totally committed to the i nterorgani zat iona 1 activity and 
has high predictability of resources from the task environment. 

These eight items are intended to measure the intensity of cooperative 
interorganizational relations. Intensity is an ordinal continuum of forms for 
resource attainment that represents increasing involvement with organizations 
in the task environment. For example, if an organizations' highest intensity of 
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involvement was Information exchange, we assume that the director was aware of 
the existence of the other organization and the directors of each organiza- 
tion were acquainted and had interacted. The potential for intensity of inter- 
organizational relations may differ ^etween hierarchical levels of organiza- 
i ons . 

IMPORTANCE OF HIERARCHICAL LEVEL 

Hierarchical level Is defined In this article as state, district, ard 
county units of an organization. This definition is different from the 
usual definition of hierarchical level as authority level within an organ- 
ization; I.e., president, vice-president, etc. In a review of literature 
in the area of interorgani zational relations, we did not find studies of 
hierarchical level as we have defined it. General organizational studies 
and some lOR literature, however, provide a logical rationale for pursuing the 
importance of hierarchical level as we define it In terms of different levels 
of organizational units. 

General Organizational Research 

Many organizational studies have focused on only one hierarchical level 

of organizational units. For example, Aiken and Hage (1968), Hasenfeld (1970, 

Milio (1971) » and Zald (1967) studied organizational units only at local com- 
munity levels. Other studies have focused on variables such as size or 

goal-displacement and have not assessed the influence of hierarchical level, 

even though the analysis encompassed two or more different hierarchical levels 

of organizations (Blau, 1970; Meyer, 1972; Mulford and Klonglan, 1970). 
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Turk's (1970:15-16) comparative study of interorgani zational systems 
supports "that both the inter-organi zational links that tie the city to its 
soc' -cultural environment, as well as those which connect its Internal 
elements, provide latent or active structures which may be used or modified 
for new purposes, provide points of articulation, or at the very least serve 
as models for new inter-organlzatlonal systems.*' By implication from Turk, 
the propensity for certain activities, such as i nterorgani zat ional relations, 
may differ between hierarchical levels. 

Sr.ructural variation in organizations may connote differing goals and 
normative behavior that may affect the intensity of lOR (Bridges et^ aj_^. , 1968; 
Lftwak, 1967; Hall, 1962). For example, in a more homogeneous county unit of 
a health organization, the unofficial structure may allow directors to exchange 
resources informally whereas the more heterogeneous, formalized state level 
structure of the same organization may require formalized agreements before 
the same kind of resources may be exchanged. 

Possible Differences 

Among the differences that may exist between hierarchical levels are 
available resources for exchange. State levels may have more or fewer resources, 
such as personnel, to exchange, depending upon methods of collection and distri- 
bution of finances for salaries. Because of the greater resources the state 
level may control, the propensity for lOR may be low since a state level 
organization may not need resources from other organizat'ons to help meet its 
goals. A county level, however, might need to pursue lOR to obtain needed 
resources . 

Types of information available for exchange and methods of exchange 
might also differ among levels. State levels often have regular newsletters with 
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wide distributions. In contrast, county levels may be financially limited to 
less for.al, more personal information and methods of exchange. 

Organizational policy may only allow state levels to make written commit- 
ments. If this were true for an organization, the intensity for lOR by 
county and district units would be limited. On the other hand, organizational 
goals may allow for cooperative interorganizational relation? at the county 
level to directly influence the target audience; state level goals may be 
more concerned with establishing organizational policy and may show little 
interest in working with other organizations. 

Given these reasons for the potential importance of hierarchical level, 
we are concerned with three specific objectives: (l) to determine if the 
theoretical ordering of lOR holds for differing hierarchical levels of organ- 
izations; (2) to determine the best empirical ordering for each hierarchical 
level of organizational units; and (3) to evaluate alternative theoretical models 
developed from the best empirical orderings for each organizational hierarchi- 
cal level. 

MEASUREt-ENT OF INTERORGANIZATIONAL RELATIONS 

One hundred and fifty-six state, district, and county levels of 35 health 
related organizations in a non-metropolitan state were studied in 1969. 
Respondents, the "top" paid administrators at the specific organiiSational level, 
were asked to respond in terms of the I8 contact organizations^ in their task 
environment in their geographical area. The eight item scale was administered 
2808 times (156 X I8) ; the usable observations after deleting those where 
the respondent's organization was also a contact organization, was 2700. The 

total administrations at the state level were 63I ; 771 at the district 
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level; and 1298 at the countv level. 

Measurement I terns 

Each of the items in the lOR scale was answered, "Yes" 
or "No." The specific questions for each item are: 

1 . Director awareness : 
As far as you know, is there (name of other organization) in this 
(stote, area, or county)? 

2. Director acquaintance ; 
Are you acquainted with the director or person in charge of (contact 
organization)? 

3« Director interaction ; 

Have you met with the director of (contact organization) at any time 
during the past year to discuss the activities of your respective 
organizations? 
k. Information exchange ; 

Is your organization on (contact organization's) mailing list to 
receive newsletters, annual reports, or other information? OR; Is 
(contact organization) on your organization's mailing list to re- 
ceive any of your newsletters, annual reports, or other information 
releases? 

5. Resource exchange ( bargain! ng) ; 

Has your organization shared, loaned, or provided resources such as 
meeting rooms, personnel, equipment, or funds to (contact organiza- 
tion) at any time during the last three years? OR; Has (contact or- 
ganization) shared, loaned, or provided resources such as meeting 
rooms, personnel, equipment, or funds to your organization at any time 
during the last three years? 
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6 • Overlapping boards or councils ( co-optat i on) : 

Does anyone from your organization or (contact organization) in- 
cluding 'taff, board members, or members serve on boards, councils, 
or committees of the other organization? 

7. Joint programs ( coal i tion) : 

Within the last three years, has your organization worked jointly 
in planning and implementing any specific programs or activities 
with (contact organization)? 

8. Wri tten agreements : 

Does your organization have any written agreements with (contact 
org<3nIzation) pertaining to personnel commitments, client referrals, 
procedures for working together, or other joint activities? 

EVALUATION OF THE lOR MEASURE 

The cumulative measure of interorganizational relations will be evaluated 
in three wa^s. First, we will confipare the three hierarchical levels of state, 
district, and county on the theoretical lOR ordering of items. Second, we will 
determine the best empirical ordering for each hierarchical level and compare 
any differences between each empirical ordering to the original theoretical lOR 
ordering. Third, we will determine hew the other two hierarchical levels fit 
to the best empirical ordering for each of the three hierarchical levels. 

Data on response patterns and scale types will be presented as a prelimin- 
ary basis for evaluation of the lOR measure. If differences exist between 
hierarchical levels on '*Yes*' response patterns and conforming scale types, we 
will have established an intuitive rationale for further analysis to more 
precisely determine the influence of hierarchical level on interorgani zational 
relations measurement. 



I tern Di f ferences 

Table I presents the frequency of ''Yes'* responses to each of the eight 

(Table 1 about here) 

scale items. Examination of precentage responses, between state, district, and 
county levels, indicates there are differences between the three levels on the 
frequency of "Yes" responses to each item. 

"Perfect" Scale Types 

Frequencies of perfect scale patterns indicate that 2025, or 75 percent, 
of the usable administrations (N=2700) conformed to one of the nine perfect 

(Table 2 about here) 
cumulative patterns. The exact forms of lOR were predicted from a summary 
score three-fourths of the time for the total administrations. The percentages 
of conforming patterns, however, differed across levels: state = 58.3^, dis- 
trict = 83.5^, and county = 78. U. This suggests that the theoretical model 
of the intensity of lOR is most applicable to the district level and least 
supported at the state level. Note that nearly half of the district {k6.3%) 
and county (k] levels have no lOR, however, a low percentage of state 
level units (13.0%) had no lOR involvement. This suggests that the evaluation 
of the theoretical model may be influenced by the lack of i nterorgani zat i onal 
relations. Our purpose is to test lOR differences between hierarchical levels; 
future analysis might consider the validit* of our theoretical model under the 
assumption that all organizations studied participated in lOR. 

Theoretical Ordering 

We will use four statistics in the evaluation of the cumulative scales 
(Guttman, 19^7; Edwards, 1957; Riley ei^ai., 195^; Nie et al., 1970): (1) the 
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coefficient of reproducibility reflects the extent to which a respondent's 
scale score predicts his response pattern; (2) the mi ni mum margi nal reproducibility 
constitutes the minimal coefficient of reproducibility that could have occurred 
for a given scale; (3) percentage improvement, the difference between the coeffi- 
cient of reproducibility and the minimum marginal reproducibility, indicates 
the extent to which the coefficient of reproducibility is due o response 
patterns; (4) coefficient of scalibility, computed b j the percentage 

improvement by the difference between the minimum marginal reproducibility 
and one, reflects the largest value possible for the percentage improvement^ 

The coefficient of reproducibility for the theoretical ordering is .8752 

(Table 3 about here) 
for the state level; .9^91 at the district level; and .9312 at the county 
level. Only at two of the levels is the coefficient above the norm of .9 for 
a valid scale. The minimum marginal reproducibility, -70191 .8719i and .8^99 
for the state, district, ana county levels, respectively, compared with the co- 
efficient of reproducibility, indicates the lOR measure is more cumulative 
(percentage improvement of .1733, -0772, .081^ for the state, district, and county, 
respectively) than chance alone would dictate. The coefficient of scal- 
ibility, state = .58IA; district = .6025, and county = .5^20, meets the norm 
of .6 at only the district level. Overall, only at the district level are 
the criteria for coefficient of reproducibility and coefficient of scalibility 
met. Statistics for the state level met r.either of these criteria. For the 
county level, the minimum for the coefficient of reproducibility was met, but 
the minimum for the coefficient of scalibility was not met. 

The statistical analysis indicates some support for the theoretical order- 
ing of the lOR items. These fipdings lead us to hypothesize that an 



empirical determination of ordering might provide an alternative lOR ordering 
tnat is statistically more significant as well as theoretically plausible. 

Empi rf cal Ordering 

^ 'ri'el orderings, using frequencies of positive responses, were devel- 
oped .or ^jch hierarchical level • A completely empirical determination pro- 
vides the best statistical evaluation criteria. Thus, as expected, the sta- 
tistical criteria for the empirical orderings are better (higher) than the 
statistical criteria using the theoretical ordering, (See Table 3-) 

When the empirical evaluations are compared across hierarchical levels, 
we see some major differences in the ordering of I OR items. None of the empi- 

(Table k about here) 
rical orders were totally homogeneous with the theoretical order. The place- 

(Table 5 about here) 
ment of director awareness, director acquaintance, and written agreements, 
however, did not fluctuate between the theoretical and empirical orderings. 
Director interaction is ordered third theoretically, but is fourth empirically 
for each hierarchical level. This suggests that interaction between directors 
involves more intense interorganizational relations than postulated. Infor- 
mation exchange is ranked fourth theoretically, but is empirically found to 
be third at the state level, and fifth at the district and county levels. As 
one possible explanation for this different order, the kinds of information 
exchanged may differ between levels. For example, the state may exchange 
generalized, easily collected information, but the district and county levels 
may have devoted greater resources to initial collection and assemblage of 
information and be less willing to share the information. Resource exchange 
changes from fifth place theoretically to sixth at the state and district 
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levels, but third at the county level. County level organizations may be 

forced, possibly because of more limited resources than state and district 

levels, to exchange resources to fulfill organizational goals. Overlapping 

boards, sixth theorreti cal ly , is a more intense form of lOR interaction, a 

consistent rank of seventh empirically, than the theoretical ordering had 

assumed. Joint programs, however, are indicative of less intense lOR than 

the theoretical ordering allowed. 

Across the three empirical models, five items retained the same order: 

(1) director awareness - first; (2) director acquaintance - second; (3) direc- 
tor interaction - fourth; (k) overlapping boards - seventh; and (5) written 
agreements - eighth. To construct theories from the empirical world, the 
consistency of the order of these items suggests these orders for the 
five items might be pursued. The other three Items, information exchange, 
resource exchange, and joint programs, may be ordered differently between or- 
ganizational levels because of true differences between levels the intensity 
of lOR indicated by each. 

Comparison statistics for the theoretical and empirical orders are pre- 
sented in Table 3. For each level, the coefficient of reproducibility and 
the coefficient of seal ibi 1 ity were increased in the empirical ordering over 
the theoretical ordering. By using only the primary criterion of coefficient of 
reproducibility (Torgerson, 1958), the theoretical and the empirical ordered 
models are valid only for the district and county levels, not for the state 
level . 

Alternative Theoretical Orderings 

Statistical differences, as well as differing orders between the theore- 
tical and enipirlcai models, imply the theoretical model should be re-evaluated 
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to determine if alternative assumptions about intensity of lOR would align 
a theoretical model more closely to the empirical data. Thus, we developed 
three alternative theoretical orderings based upon the empirical ordering 
for each hierarchical level. The first alternative theoretical ordering 
is based on the state empirical model; the second alternative theoretical 
ordering is based on the district empirical ordering; the third alternative 
theoretical ordering is based on the county empirical ordering. Differences 
in ordering of items between the original theoretical ordering and each 
alternative theoretical ordering are specified in Tables 6, 7, and 8. 

(Tables 6, 7, and 8 about here) 
Statistical comparisons indicate inconsistent improvement of the alter- 
native theoretical orderings over the original theoretical order* Examining 
the coefficients of reproducibility, the district and county levels consistently 

(Table 9 about here) 
meet the minimum criteria of .3. In none of the theoretical orderings is the 
coefficient of reproducibility 3 or above for the state hierarchical level. 
The district level meets the minimal criteria of ,6 for the coefficient of 
scalibility in the original theoretical ordering and in the second alternative 
theoretical ordering. The state level meets the ,6 coefficient of scalibility 
criteria in the first alternative theoretical ordering. These differences sup- 
port the hypothesized moderating effect of organizational hierarchical level. 
Only about half, however, of the district and county levels experienced lOR, 
The state level has had more interorganizational relations and, by its bureau- 
cratic nature, would seem to continue to be the unit most potentially involved 

in lOR, For example, state memos to district and county offices are indicative 
of lOR, Probably fewer memos, however, are sent from the district or county 
levels to the state level. 



Although the findings indicate some support for the original theoretical 
model, the alternative theoretical models, which were empirically derived, 
indicate that future anal/sis should rigorously evaluate the theoretical 
Implications of empirical orderings of lOR items. Research in several empirical 
arenas is needed to determine if support for the theoretical or empirical 
orderings differs between alternative hierarchical levels of organizations. 

IMPLICATIONS FOR INTERORGANIZATIONAL RELATIONS 

The lOR multi-item measure allows examination of alternative forms of 
organizational interaction. Theory construction and testing can be enhanced 
through measures of intersity of relationships between organizations. 

Our major purpose was to assess the general izabi 1 i ty of the measureme.nt 
of lOR across organizational levels. Although some measures of lOR, such as 
director awareness, acquaintance, and interaction, overlapping boards, and 
written agreements, are consistently ordered empirically across organizational 
hierarchical levels, other measures such as information and resource exchange 
and joint programs differed in order between levels of organizations. Thus, 
researchers and practitioners should be cognizant of the limited generaliza- 
bility of interorganizational relations measures between organizational levels. 
To the theorist, this conclusion necessitates reformulation of general lOR 
theory to allow for the moderating effect of hierarchical level. To the metho- 
dologist, the conclusion suggests alternative measurement models may be required 
for differing levels of an organization. To the applied scientist and social 
planne., working with differing organizational levels requires understanding 
ite particular forms of interorganizational relations indicative of more and 
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less intense organizational interaction. For example, a county 'eve! orqani;^a 
tion perceiving joint programs as a high intensity of lOR might be more diffi- 
cult to involve in joint programs than a district level organization that 
perceived joint programs as being of low lOR intensity. Measurement of inter- 
organizational relations allows for the assessment of the potential by a 
specific hierarchical organizational unit to engage In lOR. Etzloni's (196l:x 
statement, In discussing the bureaucratic model, is also applicable to using 
an lOR measurement model that does not allow for differing hierarchical levels 
of organizations: **Policy recommendations based on such a 'universal' model 
can lead to ill-advised action." 
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FOOTNOTE 



All statistics were computed utilizing SPSS procedures, (Nie, et al . , 
1970). 
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